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ABSTRACT 


A technique is developed that is intended to provide a systematic 
approach to synthesizing display augmentation for optimal manual control 
in complex, closed-loop tasks. A cooperative control synthesis tech- 
nique, previously developed to design pilot-optimal control augmentation 
for the plant, is extended to incorporate the simultaneous design of 
performance enhancing displays. The technique utilizes an optimal con- 
trol model of the man in the loop. It is applied to the design of a 
quickening control law for a display and a simple K/s plant, and then 
to an F-15 type aircraft in a multi-channel task. Utilizing the closed 
loop modeling and analysis procedures, the results from the display 
design algorithm are evaluated and an analytical validation is per- 
formed. Experimental validation is recommended for future efforts. 
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CHAPTER J_ 

INTRODUCTION 

The utility of providing augmented displays to the human operator 
as an aid in the closed -loop control of high order dynamical systems is 
well known, and discussion of some of the early work done in evaluating 
various types of augmented displays can be found in [1]. With the 
advent of high performance aircraft, the amount of information to be 
processed by the pilot to successfully accomplish the assigned task has 
continued to increase. It has, therefore, become more critical to 
determine the best informational set and display dynamics needed by the 
pilot so as to reduce the pilot's workload and improve performance. For 
example, the use of flight directors to achieve this objective has been 
analytically evaluated in [2] using closed loop or "pilot - modeling" 
techniques, and validated through man -in -the -loop simulation in [3]. 

Ongoing research in the area of automatic flight test trajectory 
controllers [4,5] has demonstrated the usefulness of such controllers, 
rather than manual control, for accurately following specified complex 
trajectories. These controllers, however, take the pilot out of the con- 
trol loop, and it is desirable to avoid this. The possibility of doing 
so while aiding the pilot with an appropriate display is worth explor- 
ing, and that is 'the subject of this work. 

In general, the design of active displays for the human controller 
requires extensive real time man-in-the-loop simulation to evaluate 
various candidate designs. Although simulator validation is always 
appropriate, the objective of this study is to develop an analytical 
technique to aid in the design of pilot-optimal display augmentation 
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systems. 

In the past, analytical methods have been proposed in which models 
of human behaviour were used to identify, investigate and evaluate the 
properties of augmented aircraft dynamics. In all these methods, how- 
ever, the "pilot model analysis” was added a posteriori. The idea that 
the augmentation system works in cooperation with the pilot and a tech- 
nique which considers the augmentation system and the pilot to be two 
controllers working in "parallel" was first suggested by Schmidt [7], 
This technique was later modified and its application to synthesize con- 
trol augmentation that directly optimizes pilot opinion rating was 
demonstrated for a modern control configured aircraft [8,9]. The 
cooperative control synthesis technique has the advantage that it incor- 
porates a mathematical model of the pilot behaviour and uses optimal 
control theory to synthesize control gains that are pilot-optimal as 
modeled. 

Since display augmentation, like control augmentation, has to be in 
harmony with the pilot's abilities and limitations in order to be 
acceptable to him as an aid in accomplishing his task, the cooperative 
synthesis technique is considered to provide an appropriate framework 
for synthesizing pilot-optimal display augmentation. 

Even though the objective of both the control augmentation and the 
display augmentation is to aid the pilot, the way this is achieved is 
fundamentally different for the two types of augmentation. The differ- 
ences between these two types of augmentation are best understood by 
considering the simplified block diagrams of Figures (1.1) and (1.2). 
Figure (1.1(a)) depicts the pilot controlling an unaugmented vehicle. 

For this case, the responses (y) observed by the pilot are those being 




(a) Unaugmented Vehicle 


(b) Control Augmentation 



(c) Display Augmentation (d) Control and Display Augmentation 


Figure 1.1 Simplified Block Diagrams for 
Control/Display Augmentation 

















(a) Control Augmented Vehicle 



(b) Display Augmented Vehicle 
Figure 1.2 Control vs. Display Augmentation 








controlled by the pilot. 

Figure (1.1(b)) shows the case of a pilot controlling an augmented 
vehicle. Note that the control augmentation changes the effective plant 
dynamics being controlled by the pilot, and may be designed so as to aid 
the pilot in accomplishing his task and to achieve desired dynamics for 
improved handling qualities. Here again, however, the responses (y) 
observed by the pilot are still those he is directly controlling. 

Figure (1.1(c)) shows a simplified case of display augmentation, 
wherein the vehicle responses drive a display observed by the pilot. 

Note that any display dynamic augmentation does not change the charac- 
teristics of the vehicle dynamics being controlled (i.e. y/u is 

P 

unchanged). It only modifies the dynamics being observed by the pilot 

(or x,/u ). Here, clearly, though the pilot observes and controls x, 
dp d 

(the displayed signal), the controlled variables of interest are still 
the vehicle responses y. The case of combined control and display aug- 
mentation is shown in Figure (1.1(d)). 

Consider the manual control of a vehicle G(s), with control augmen- 
tation such that the augmented vehicle is G'(s), as in Fig. (1.2(a)). 

The closed-loop transfer function, including the pilot, from some dis- 
turbance u w to the vehicle output y is 


y(s) = 


G'(s) 


u (s) 


( 1 . 1 ) 


1 + G'(s) P'(s) w 

where P'(s) represents the pilot describing function. Next consider the 
pilot controlling the vehicle without control augmentation but with 
display augmentation, as in Fig. (1.2(b)). The closed-loop transfer 


function for this case is 
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Now if the display dynamics D(s) are chosen, for example, such that 
G(s)D(s)=G'(s) , then the pilot describing function P(s) of the display 
augmentation case (Fig. (1.2(b))) is approximately the same as P'(s) for 
the control augmentation case. Then Eqn. (1.2) becomes 


y(s) ' 1 + G' (s) ^P' (s) u w (s) (1 * 3) 

Comparing Eqn. (1.3) to Eqn. (1.1), it is apparent that though the sta- 
bility characteristics in terms of the closed-loop characteristic polyn- 
mial are the same for the two cases of augmentation, the closed loop 
transfer functions are not. The point here is that the closed-loop sys- 
tem dynamics obtained through control augmentation may be quite dif- 
ferent from that obtined through display augmentation. 

Chapter 2 of this report provides motivation for display augmenta- 
tion through analytical evaluation of various display "quickening" con- 
trol laws, synthesized essentially through trial and error, for a simple 
2 

K/s plant. A compensatory tracking task is analyzed using an Optimal 
Control Model (OCM) [6] of human behavior. 

In Chapter 3 a methodology to synthesize pilot-optimal 
display/ control laws which is sensitive to the control and information 
processing limitations of the human controller is proposed. This metho- 
dology is an extension of the cooperative control synthesis technique 
previously developed to design pilot-optimal control augmentation 
[7,8,9]. Though the proposed methodology has been developed so as to be 
applicable to simultaneous synthesis of pilot-optimal control augmenta- 
tion and display augmentation, the present discussion focuses on the 
application of the technique to display design only. 


The application of the cooperative display design technique to 
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o 

again synthesize display laws for the K/s plant in the tracking task is 
discussed in Chapter 4. When compared to the results of Chapter 2, the 
results of this application tend to analytically validate the synthesis 
procedure. The displays lead to predicted reduction in pilot workload 
when evaluated using the OCM. Also the ability of the methodology to 
provide task tailoring of the displays is demonstrated. 

In Chapter 5 the application of the methodology to high order 
dynamical systems in a multi-control task scenario is demonstrated for a 
modern aircraft. The chosen model closely represents the unaugmented 
longitudinal dynamics of the F-15 aircraft, and the task is that of 
tracking a normal acceleration command while regulating Mach number. 

The control inputs available to the pilot are the elevator stick and 
throttle. Model-based evaluation of the synthesized display again indi- 
cates reduction in pilot workload in accomplishing the task. 

Finally a summary of the work is presented in Chapter 6 and recom- 
mendations made for future research. 
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CHAPTER 2 


ANALYSIS OF DISPLAYS FOR A K/s 2 PLANT 


Motivation for providing the human controller with augmented 
displays is explored through analytical evaluation of various 

2 

emperically-derived display "quickening" control laws for a simple K/s 
plant. The results of this evaluation agree with the known fact that 
the human operator's workload can be significantly reduced and his per- 
formance improved by a proper design of the signal being displayed to 
him. 


2 

J2 ._1_ K/ s Plant and Task Description 

2 

Consider the K/s plant dynamics as discussed, for example, by 
Kleinman et al. in [6]. The system state equations are 


• 

X 


0 

l‘ 


X 


o' 

• • 
L x J 


0 

0 


• 

X 

+ 

K 


«(t) 


( 2 . 1 . 1 ) 


where x(t) is the plant position and 6(t) is the input from the human 
controller. 

A velocity disturbance is applied to the plant. It is modeled as a 
first order Markov process having a break frequency of 2 rads/sec and is 
given by 


*j(t) - -2xj(t) + w(t) (2.1.2) 

2 2 

where w(t) has intensity W = 0.217 to give E{Xj} = 0.054 in. Defining 
the plant position error (e) and the error rate (e) as 

e(t) ~ x 2 (t) ; e(t) — XjCt) + x-j(t) (2.1.3) 

and letting K = 1 in. /in., the plant equations (2.1.1) can be combined 
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with the disturbance equation (2.1.2) to get 


x„ 


or in concise form 


-2 

0 

o' 


X 1 


'o' 


Y 

1 

0 

1 


X 2 

+ 

0 

6(t) + 

0 

0 

0 

0 


x„ 


1_ 


0. 


X 3 


w( t) 


x=Ax+Bu+Dw (2.1.4) 

o o o 

The human operator's task is to minimize the position error x^(t) in the 
presence of the disturbance. 

Next consider a display exhibiting some transport lag modeled in 
the form 


x d ( S ) = T t e(s) (2.1.5) 

d 

The dynamics of the disturbance, plant, and display can then be written 
as 


• 





r i 


r -• 




A 

0 





B 


D 

X 


o 



X 


0 


o 

• 

SS 

zL 

_± 



+ 

0 

6 + 

0 

Y 



x d 



X d 



x , 




_ 


- 



_ d 

d_ 






The human operator's observations for this system are 


( 2 . 1 . 6 ) 


y x = x d (2.1.7) 

y 2 = X d 

where it is assumed, in accordance with the known abilities of the human 
controller, that he is able to reconstruct the displayed-variable rate 
by observing the displayed variable itself. 

As shown in Fig. (2.1), the human operator's task with the display 
is to keep the needle on the display centered to the best of his 
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abilities, subject to reasonable workload. This performance objective 
can be reflected in terms of minimizing the cost 

T 

J (6) = E{lim -jr J(x? + g6 2 )dt} (2.1.8) 

P t->-“ T o d 

With the above formulation in mind, the performance of the manually 
controlled system f is evaluated using the OCM model for various values of 
• A brief description of the OCM modeling technique is given in 
Appendix B. For all the analysis carried out in this section, the 
parameters that define the OCM model were set to the following values: 

(i) Human operator's observation time delay, t, set to 0.2 
seconds 

(ii) Observation- noise ratio set at -20 dB for both observations 

(iii) Motor noise ratio was set at -25 dB 

(iv) The weighting, g, on the control rate in the human 
controller's objective function was always adjusted to yield a neu- 
romotor lag time constant,^, of 0.1 secs. 

(v) Very low values of thresholds were used for the observations 
available to the human, and he was assumed to devote full attention 
to the displayed signal. 

The OCM model obtained for the above values of the parameters has been 
shown to correlate very well with the experimentally observed behaviour 
of the human controller [6], especially in single-axis tasks such as the 
one being discussed here. The significance of these parameters in 
modeling the human operator dynamics is explained in Appendix B. 
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The results for various values of display lag are presented in 

Table 2.1, in terms of the mean square values of the variables of 

interest. These results are also plotted in Figures (2.2) and (2.3) (to 

be discussed later) and correspond to the curve marked (T) in these 

figures. From these results it is clear that with only error e driving 

the display, the pilot's performance improves as the display bandwidth 

is increased. As — - -*■ °° the pilot's performance approaches a limiting 

T d 

case where the error is displayed instantneously to the human, or the 
limiting case where there is no display lag. This limiting idealized 
case (labeled A in the figures) assumes that the error can be sensed and 
displayed without any computational delay or lag, and may not be achiev- 
able. The question now is whether the performance (or pilot's workload 
situation) can be improved by augmenting the display dynamics. 


Display Quickening For K/s z Plant 
Consider the augmented display dynamics of the form 


*d = tKi + tS + Vs 

a a 


(2.1.9) 


where g^ is a gain to be adjusted. Since x^(t) is the plant velocity 
state, the above form of display will provide some lead information to 
the human. Note that this form of display dynamics can be written in 
general as 


x d = a d x d + u d 

U d = G d y d (2.2.1) 

where y, = C,x is the vector of plant responses available for driving 
a a 

the display, and u, is the display control law to be determined. In the 

U 

formulation of display dynamics as above, the choice of a^ determines 
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TABLE 2.1: OCM RESULTS FOR VARYING DISPLAY BANDWIDTH 


T d 

( sec) 

M.S. Error (e) 
(in. 2 ) 

M.S. Input (6) 
(in. 2 ) 

M.S. Control Rate (6) 

,, 2. 2. 

(in. /sec ) 

0.20 

0.0215 

2.176 

106.91 

0.10 

0.0177 

1.543 

76.47 

0.05 

0.0157 

1.353 

67.44 

0.02 

0.0142 

1.261 

62.9 

0.01 

0.0135 

1- 223 

60.98 

-> 0 

0.0131 

1.141 

54.73 






nean Square Erroi 



0 20 40 60 80 100 


2 2 

Mean Square Control Rate (In. /sec ) 

Nomenclature 

( 7 ) Only e driving display, = .20 - -> 0 

© x d = .10, g d = 1, 2, 3, 4, 5, 6; B : g d = 2 

© r d = .05, 8(J = 1, 2, 3, 4, 5, 6; C : g(J = 3 

t in seconds 


Figure 2.2 Parametric Performance — Manual Control Rate 


Mean Square Error (in. 
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Nomenclature 

(T) Only e driving display, = .20 - -> 0 

© T d = .10, g d = 1, 2, 3, 4, 5, 6; B : g(J = 2 

© T d = .05, g d - 1, 2, 3, A, 5, 6; C : g d = 3 

Tj in seconds 

Figure 2.3 Parametric Performance - Manual Control Activity 
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the bandwidth of the display. 

With the same OCM parameters as above, an analysis was performed 

for two values of x : .10 and .05 secs. These values were chosen so 

a 

that the display dynamics are near the bandwidth of the human controller 

as modeled. For each of these values, g, is varied from 1 to 6. The 

d 

results are presented in Table 2.2 and are also plotted in Figures (2.2) 
and (2.3) so as to compare them with the previous results. In the two 
figures, the curve marked corresponds to x^ = .10 secs and that 
to = .05 secs . 

Fig. (2.2) is a plot of mean square error (e) vs. mean square 
manual control rate (6) for the various display cases discussed above. 
Fig. (2.3) is a plot of mean square error vs. the mean square manual 
control input (6). From these two figures it is clear that the mean 
square control input and control rate both decrease as the display con- 
trol gain g^ is increased. The mean square error initially decreases as 
g^ is increased, and then increases beyond a certain value of g^ that 
depends on the choice of display bandwidth. 

Note that earlier work [10,11] has shown that the human operator's 
workload is directly related to his mean-square control rate. This means 
that it should be possible in this case to improve performance (of which 
mean square error is a measure), while at the same time decreasing work- 
load. Moreover, the results indicate that for a given display bandwidth 
there is an optimal choice of display control gains. For example, point 
C in Figures (2.2) and (2.3) is such an optimal display for x^ = .05 
secs, and for this case the performance is slightly better than even the 
idealized limiting case at point A. 


marked (T) 
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TABLE 2.2: OCM RESULTS FOR VARYING DISPLAY CONTROL GAINS 


> T d = 

.10 secs 


8 d 

M.S. Error (e) 

M.S. Input (6) 

M.S. 


(in. 2 ) 

(in. 2 ) 


1 ' 

0.0144 

1.113 


2 

0.0138 

0.733 


3 

0.0143 

0.486 


4 

0.0157 

0.339 


5 

0.0175 

0.248 


6 

0.0195 

0.187 


T d = 

.05 secs 


8 d 

M.S. Error (e) 

M.S. Input (6) 

M.S. 


(in. 2 ) 

(in. 2 ) 


1 

0.014 

1.175 


2 

0.013 

0.968 


3 

0.0127 

0.789 


4 

0.0128 

0.639 


5 

0.0131 

0.521 



Control Rate (<5) 
(in. 2 / sec 2 ) 

54.75 

35.92 



Control Rate (6) 

f 2 2 

(in. /sec ) 

58.06 
hi. hi 
38.49 
30.97 
25.15 


0.0136 


0.427 


20.46 
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It would then appear desirable to develop a systematic approach to 
display augmentation which will make it possible to directly synthesize 
the optimal display gains without having to resort to trial and error. 

In the following chapter an extension of the optimal cooperative control 
synthesis technique [7-9] is proposed as a methodology to accomplish 


this. 
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CHAPTER 2 

OPTIMAL COOPERATIVE CONTROL / DISPLAY DESIGN METHODOLOGY 

The problem formulation for the cooperative control/display design 
methodology is presented and the necessary conditions for optimality are 
derived in detail. Application of the methodology to pilot-in-the-loop 
synthesis is demonstrated and various special cases of augmentation are 
discussed. 

2»_1 Problem Formulation 

In this section the mathematical formulation of the cooperative 
control synthesis technique is presented. Necessary conditions for the 
simultaneous optimality of the display and control augmentation systems 
are developed in the sections that follow. The procedure followed here 
is very similar to that of [8,9], 

Consider a dynamic system acted upon by two controllers, and 
described by the linear time invariant set of first order differential 
equations 


* " V + B lo U l + B 2o u 2 + V (3.1.1) 

n — __ 

with xeR , u^eR , u^eR and w a zero-mean Gaussian white noise process 
with intensity W. The two controls represent two physically independent 
controllers, and in section (3.5) it is shown how the controller 1 (u^) 
can be made to closely approximate the OCM model of human behaviour. 

The display dynamics are assumed to be of the form 


x d = A d x d + B do u d 


d 

with x^eR , u^eR , and u^ is the display quickening controller. 


(3.1.2) 

The 
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objective is to find the optimal cooperative controllers 1 and 2 
(u^ and ^) along with the optimal display control law u^. 

Controller 1 (u^) is assumed to have noisy observations available 
for feedback given by 


y, = C. x + C x, + C u, + v 
1 lo did ud y 


(3.1.3) 


where v^ is also a zero-mean Gaussian white noise process with intensity 
V . This controller will be shown to include state estimation. 


y 

The augmentation controller and the display control law u^ are 
assumed to have noise-free system outputs and y^, respectively, 
available for feedback, where 


y 2 “ C 2o x; 


Note that the above formulation dce£ 



(3.1.4) 


not allow feedback of the display 


states to the augmentation controller u^. Finally, these two latter 
controllers are constrained to have the direct output feedback form 


U 2 " G 2 7 2 = G 2 C 2o X 

(3.1.5) 

The interaction between the different controllers is shown in the block 
diagram of Figure (3.1). 

3_.2_ Design Objectives 

Controller 1 is to be optimal with respect to the cost 



in the presence of the action of control inputs Uj and u^. 


u d ' Vd ‘ °d c d 


Here E{*} 
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indicates the expected value operator and the weighting matrices are 
Q l0 > 0» > 0, > 0, > 0. Conversely, Controller 2 (U 2 ) and the 

display control law are to be optimal with respect to the cost 

T 

= E{lim / ^ xT Q2 0 x+x d ( ^2d X d +u l R 2 u l +u 2 F 2 u 2 +u d F 2d u d^ dl: ^ ( 3 * 2 * 2 ) 
in the presence of the control action . The weighting matrices are 

Q 2o > °> Q 2 d * °» R 2 > °» F 2 > °» F 2d > °* 

Augmenting the system dynamics (3.1.1) with the display dynamics 
(3.1.2), the state-space description of this augmented system is 


A 0 
o 


+ 


-l- - 

B 2o 


U 

"o' 

p 

0 

u 2 + 

B, 

_ “°_ 

*d + 


lo 

0 

D 

o 

0 


u. 


w 


(3.2.3) 


Defining x = COL (x, x d ) , (3.2.3) can be written in a compact form with 
appropriate definitions for the matrices as 


X = Ax + + B 2 U 2 + B^u^ + Dw 

The measurements can similarly be written as 


(3.2.4) 


y l = C l x + C u u d + v y 

y 2 = c 2 x 
^d = V 


(3.2.5) 


The two cost functions can then be expressed in terms of the aug- 
mented state vector "x as 


T 

Jj = E{lim y / (x T QjX + u i R i u i + u 2 F l u 2)dt> 
T 

J 2 = Eflim y / (X T Q 2 + ^2 F 2^2 +U d F 2d U d 
T-** 8 o 


(3.2.6) 
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where the weighting matrices and 0 2 are appropriately defined. (Note 
that this formulation is formally that for a multi-player non-zero sum 
game, and we seek a Nash solution [22]). 


_3._3 Solution for u^ 

In the presence of the action of control inputs u 2 and u^, as given 
by (3.1.5), the dynamics of the augmented system (3.2.4) are 


where 


X = A x + ®iU. + Dw 
aug * 11 

y, = C x + v 
1 aug* y 


A - (A + B 0 G 0 C 0 + B ,GjCj) 
aug = 222 d d d 

C - (C, + C G.C.) 
aug = 1 u d d 


(3.3.1) 


(3.3.2) 


and the performance index becomes 


T 

Jj = E{lira j /( X T (Q 1 +C 2 G 2 F 1 G 2 C 2 )x + uj^u^dt} (3.3.3) 

Equations (3,3.1) and (3.3.3), in the case of uncorrelated process 
and measurement noises (w and v^) and for > 0 (i.e. - positive 

definite), describe the standard non-singular linear quadratic Gaussian 


T T 




regulator problem for controller u^. The optimal controller is known 
[12] to have the form 


a 

u L = KjX (3.3.4) 

a 

where x is the minimum mean-square estimate of the system state vector 
X. The gain matrix is given by 

K = -R^B^P (3.3.5) 

with P > 0 and symmetric, the solution of the algebraic Ricatti equation 
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aug P + PA aug + (Q 1 +C 2 G 2 F 1 G 2 C 2 ) - PBft^P = 0 (3.3.6) 

The dynamics of the Kalman state estimator are 


X = A x + B.u, + M.(y, - C x) 
aug A 11 1 W 1 aug* 

where the Kalman filter gain matrix is given by 


(3.3.7) 


T -1 

M = E C V 
1 aug y 

with E (> 0) the solution of the algebraic Ricatti equation 


(3.3.8) 


A J + I A T + DWD T - EC T V _1 C E = 0 


aug 


aug 


aug y aug 


(3.3.9) 


_3 .4_ Solution for u^ and u^ 

The optimal controller u^ as derived above has the form 


= Kjx; X = \X + M,y 


l'l 


(3.4.1) 


where A, — (A +B,K 1 -M,C ). Then in the presence of this control 

1 = aug 11 1 aug 

action u^ , the system dynamics (3.2.4, 3.3.4, 3.3.7) can be written in 
terms of the augmented state vector q — COL (x> x) as 


q = 


" A BjKj" 


B 2 


" B d‘ 


D 0 ‘ 


w 

M 1 C 1 A 1 

q + 

0 

u 2 + 

M l C u 

u d + 

0 Mj 


v 

_ y 


(3.4.2) 


which can further be written in a compact form, with appropriate defini- 
tions of matrices, as 


q = A^q + B^U 2 + B^u^ + D'w' 


(3.4.3) 


The intensity of the process w' is W' = 


W 0 
0 V 


The index of performance to be minimized by ^ and u^ then becomes 


J 2 = E{lim y /(9 T Q'q + U 2 F 2 U 2 + u d F 2d u d )dt} 
T+ 00 1 o 


(3.4.4) 
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with 


Q' A 


K [ R 2 K 1 


The design objective can then be stated as that of finding the optimal 
controller u 2 and optimal display control which minimize the cost J 2 
as given by (3.4.4), subject to (3.4.3). 

Proceeding in a way as detailed in Appendix A, it can be shown that 
the gains G 2 and which correspond to the simultaneous optimality of 
the two controllers u^ and u^ are given by 



_T 


T 

G 2 = -F 2 1[B 2 01 HL 

C 2 


C 2 

0 

([C 2 0] L 

0 


_ 


_ 


-1 


and 




T 



_T 

G d - - p 2i 

B d 


C d 


C d 

M l C u 

hl 

0 

([C d 0] L 

0 


_ _ 


m 


__ m 


>-1 


T 

Here, L = E{q q } satisfies the relation 


A L + LA T + D'W'D' 1 = 0 
c c 


and H satisfies 


(3.4.5) 


(3.4.6) 


(3.4.7) 


AH + HA + Q = 0 
c c 

where the following definitions have been used 


A A 
c = 


(3.4.8) 


" A 

aug 

B l K l' 

— A 

ftwKWd 0 

M.C „ 
1 aug 

v 

; Q | Q' + 

o 0 


The solutions (3.4.5) and (3.4.6) are derived from the gradient condi- 
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ti-ons 


and 


3J, 

i 

3G„ 



— -i 

_T 


„T 


C 2 


C 2 

2{F 2 G 2 [C 2 ° IL 

0 

+ [B T 2 0] HL 

0 


} = 0 


(3.4.9) 


3J, 

3G = 2 ^ F 2d G d^ C d °^ L 


M.C 
1 u 


HL 


} = 0 


(3.4.10) 


respectively, as shown in Appendix A. 

Equations (3.4.7) to (3.4.10) then give the four necessary condi- 
tions for the simultaneous optimality of the display and control augmen- 
tation for the task, as defined by the performance index J given that 
Controller 1 is of the form stated in (3.4.1). 


_3.5_ Application to Pilot-in-the-Loop Synthesis 

In the preceding sections, a dual performance optimization problem 
was discussed and the necessary conditions for the optimality of the 
various controllers, and the expressions for the resulting gain 
matrices, were derived. The association of Controller 2 (u^) with plant 
augmentation, and of display control (u^) with the display augmentation 
should be apparent in the above formulation. In this section it will be 
shown that Controller 1 (u^) can be made to closely approximate the OCM 
model of human behaviour by an appropriate choice of the relevant param- 
eters. In this manner the cooperative methodology, as developed above, 
can be used to do "pilot in the loop" synthesis of the display/control 
augmentation design. 

Consider the Optimal Control Model as discussed in Appendix B. 
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A — T A T T 

With u p — P 0 (t) and x p — [x , u p (t)], the dynamics of the augmented sys- 
tem in Equation (B.4) are 

x (t) = A x (t) + B. u (t) + D w(t) (3.5.1) 

p op lo o o 

with A , B. , and D as in (3.1.1). 
o lo’ o 

The observations available to the pilot, as given by (B.2) can be 
rewritten as 

y p (t) = C Q x p (t-T) +v(t-x) (3.5.2) 

where C = [C | d] , and the pilot's cost function (B. 3) becomes 

T 

J (V*> = E{lim y / (xjo x + yJnOdt} (3.5.3) 

P T^°° o' 5 " 

Comparing the above formulation for with that for Controller 1 
(^) as in Section (3.3) we notice that Equations (3.5.1) to (3.5.3) 
have the same form as Eqns (3.3.1) to (3.3.3), but for the simplifica- 
tion that the time delay, t, has been eliminated in the observations for 
u^. The absence of the time delay simplifies the dynamic order of the 
pilot model by eliminating the linear predictor in the control Structure 

(B.17, B.18). The motor noise (v in (B.12)) is however accounted for 

m 

in this formulation in that it may appear as an additional disturbance 
in Eqn. (3.3.1). The structure of the pilot model as represented by 
Controller 1 (u^) is as shown in Figure (3.2). 

It is worth mentioning here that, though the simplified pilot model 
is used in the synthesis procedure presented in this report, the com- 
plete model (with predictor, etc.) is used to evaluate these designs. 
Moreover, at each Iteration of the synthesis process, the parameters 
(e.g. noise intensities) in the simplified model are updated to yield 



Observation 



Figure 3.2 Simplified Pilot Model Block Diagram 
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results that are consistent with the complete OCM model. It has been 
shown in [9] and [16] that by selecting proper noise intensities for the 
control noise and the measurement noise v , the simplified model may 
yield the same human operator dynamics as the complete OCM model. 

_3.6_ Numerical Solution Algorithm 

For the case of only control augmentation (u£> being designed, the 
problem reduces to one discussed extensively by Innocenti in [8,9] as 
the Linear Optimal Cooperative Regulator (LOCR) problem. With the 
display- related terms removed from the problem formulation, the neces- 
sary conditions for optimality as derived above reduce to those in 
[8,9]. 

For the case of only display control law being designed, the neces- 
sary conditions simplify, with the terms related to Controller 2 (u_) 
removed from the problem formulation. The block diagram for the con- 
troller interaction is the same as in Figure (3.1) but without Con- 
troller 2. A brief description of the solution algorithm, alongwith a 
flow chart for the computer program written to implement the display 
synthesis procedure, is provided here. Since the algorithm is very 
similar to that in [8,9], the reader is referred to the references for a 
more detailed description. 

The problem formulation for the case of display augmentaion only 
can be summarized as follows: 

Given the linear time invariant system 


X = Ax + B lU]L + B d u d + Dw 


y. = C. x + C u , + v 
1* u d y 


(3.6.1) 
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y d " C d* 

we wish to determine the optimal controllers u, and u, that minimize 

l a 

respectively 


T 

J l = E{lim i / (x\x + u^RjU^dt} 


(3.6.2) 


T+°° o 


and 


J 2 = E{lim y /(x T Q 2 )C fu iR2 u l +u d F 2d U d^ dt ^ 


(3.6.3) 


subject to the constraint 


u d = G d y d (3 * 6 * 4) 

In Equations (3.6.1) to (3.6.4) all the vectors and matrices are as 

defined in Section (3.2). 

The numerical procedure solves for the display control law (u^) 
which satisfies the necessary conditions of optimality for the cost J 2 
(3.4.7 to 3.4.10), given that the corresponding Controller 1 (u^) is 
optimal with respect to the cost (or satisfies 3.3.5 to 3.3.9). The 
algorithm for the solution procedure is summarized in Fig. (3.3) and a 
step-by-step description of the algorithm is given in the following. 


Step-1. This step consists of selecting a starting display control 
law Uj to initialize the numerical optimization procedure. A reason- 
able choice (as is shown in later application) is to-select G, such 

d 

that the display variables x^, as given by (3.1.2), closely approxi- 
mate those observations of the pilot which are of primary importance 
for accomplishing the assigned task. 


Another important choice to be made, before starting the iterative 
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Figure 3.3 Flowchart for Numerical Procedure 
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procedure, is that for the intensities of the noise processes w and 
v . These should be chosen such that the optimal Controller 1, for 
the starting display augmentation, closely represents the OCM pilot 
model. 


Step-2. Solve for the optimal Controller 1 ("u ^ ) , as detailed in 
Section (3.3), for the initial display augmentation, and compare with 
the corresponding OCM pilot model to confirm that the choice for the 
noise intensities is appropriate. 


Step-3. Form the closed loop system, as in (3.4.3) and (A. 4 of 
Appendix A), for the current display augmentation (u^) and the 
corresponding optimal Controller 1. Solve the Lyapunov equations 
(3.4.7) and (3.4.8) for the matrices L and H, respectively. Obtain 


3J, 


the cost J 2 as in (A. 6) and the gradient as in (3.4.10). 


Step-4. Next a conjugate gradient search procedure is used to 
upgrade the display control law u^. This consists of making incremen- 
tal changes in the gain matrix in the negative gradient direction 
till a value of is reached for which the cost J 2 shows an increase 

as compared to its value over the previous step. Note that at each 
incremental step the controller u^ is updated to be the LQG con- 
troller for the current display law u, . 

d 


dJ 2 

Step-5. Calculate -777- for the display control gains G, obtained at 

Ovjr - a 

a 

the end of Step 4 and check whether the necessary condition (3.4.10) 
for J 2 to be minimum is satisfied. If yes, then go to Step 6 other- 
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wise go back to Step 3. 

Step-6. Check for the convergence of the entire iterative process. 
This is done by evaluating the difference between the display control 
gains obtained at the end of Step 5 and those at the start of Step 
3. If this difference is less than some bound e, then proceed to 
Step 7, otherwise go back to Step 3 and repeat the gradient search 
procedure. 

Step-7. The Controller u^ and the display control law at the end 
of Step 6 are the optimal solution for the problem formulated as 
above. But we further require that the Controller 1 be an approximate 
representation of the human behaviour as modeled by the optimal 
control- theoretic model. Therefore the control gains and closed loop 
statistics obtained at the end of Step 6 are compared with the 
results of the evaluation of the corresponding display augmented sys- 
tem using the OCM model. If a reasonable agreement is obtained 
between the two results, then the display control law obtained is 
pilot-optimal and the iteration process is stopped. Otherwise the 
noise intensities v^ and w are updated and the iteration process 
started anew from Step 1. 
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CHAPTER 4 

APPLICATION OF DISPLAY DESIGN METHODOLOGY TO K/s 2 PLANT 


Using the algorithm discussed in Chapter 3, various display augmen- 

_ 2 
tation control laws, u^ , will be synthesized for the K/s plant. The 

control laws are evaluated, using the full-order OCM model, in terms of 
the mean square values of the variables of interest, and the power spec- 
trum of the human operator's control input. Detailed frequency domain 
analysis is also carried out for the various displays. 


._1_ Problem Formulation and S ynthesi s Results 

2 

The dynamics of the K/s plant augmented with the display may be 
expressed in the form 


• . 





- _ 




_ _ 

— 


A 0 1 





B 




D 

X 


o 


X 


0 


0 


o 

X ’ 

• X 

« 


0 a d 


x d 

+ 

0 

6 + 


u d + 

0 


(4.1.1) 


with A q , B q , D q and the intensity W of the white noise process w as 
defined in Section (2.1), and = 1 . Here the display dynamics are as 
in (2.2.1), and u rf is the display control law to be determined. 

As discussed in Chapter 3, Controller u^ in the cooperative problem 


formulation is analogous to the control rate u^ of the OCM. So defining 
* • 

Uj — 6, the dynamics of Eqn. (4.1.1) can be written as 


X 


fA 0 B " 






o 

o 


X 

x d 

= 

0 a d ° 


x d 

• 

5 


0 0 0 _ 


_<5_ 


where the control noise term, v , 

m 


o' 

0 

U 1 + 

'o' 

1 

u d + 

D 0 
o 

0 0 


w 

V 

_1 


p 


0 T- 

n 


m 


is the human's "motor noise". 


The 
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outputs available for feedback to Controller 1 (u^) are the same as the 
human's observations. Therefore for the display augmented case 


— *T — 

Yj = x d ] ' + v (4.1.3) 

where v is the human's observation noise. To be consistent with the 

y 

analysis of Chapter 2, the responses driving the display are chosen to 
be 


y d = fx 2 , x^] (4.1 .4) 

where x 2 (t) and x^(t) are the position error and the plant velocity, 
respectively, and are as defined in Section (2.1). Then the display 
controller, to be designed, has the form 


u d = Vd (4 - K5) 

with = fg d 2 » ®d3^* T ^ e ^ uman operator's objective for the display- 

augmented system is to regulate the displayed variable x,. Thus the 

d 

controller u^ minimizes the cost function , where 


J, = E{lim i /(** + r. u^)dt} (4.1.6) 

1 T-~> T o d 11 

Here the choice of r^ depends on the desired neuro-muscular-lag time 

constant x^ of the human as modeled. For the purposes of the display 

2 

design for the K/s plant, r^ was continually adjusted to yield x^ Z 0.1 
secs. 


The objective in the display design is to help the human operator 
regulate the tracking error e (= x 2 ), in the presence of the velocity 
disturbance, and with minimal workload. This objective can be formu- 
lated as that of finding the optimal display control law u^ of the form 
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(4.1.5) which minimizes the cost function J where 


T 

J 2 = E{lim y J(o. e e 2 + r 2 uj + f 2d u^)dt} 


(4.1.7) 


T-h» o 

Equations (4.1.2) to (4.1.7) then define the problem formulation 

2 

for the display design for the K/s plant, within the framework of the 
cooperative methodology. Using the algorithm discussed earlier, the 


optimal display control gains, G,, are determined for various values of 

a 

relative weighting on the error in cost function J^. Here relative error 


weighting is defined as the ratio — which is varied by changing q 

r 2 ' 6 

and/or r The results are presented in Table 4.1. Note that in 
(4.1.7), f needs to be positive definite in order to get a finite 
optimal solution to the problem. However, since the display control 
does not reflect any measure of energy, the weighting f^ may be chosen 
to achieve some selected overall display gain, or sensitivity. For the 


results presented in this section, simply a constant value of f = .001 

zd 


ss 


is not constant. 


is used, and note that the display sensitivity 

Since the algorithm that synthesizes the optimal gains is itera- 
tive, a starting display gain matrix has to be specified. For the 


results presented in Table 4.1, = [20, 0] is used for the starting 

dislay control law. (Note from Section (2.1), the starting gains are 


such that the displayed variable x^. is just lagged error). Also, for 

comparison with the results of Section (2.2), a, = -20 sec * was chosen 

d 

(this corresponds to x. = 0.05 secs). The weighting r. in J, , and the 

d 11 

variances for the noise processes v^ and v^ are constantly updated in 
the iteration process in order to make the controller u^ closely approx- 
imate the OCM model with the parameters selected as in Section (2.1). 
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TABLE 4.1: OPTIMAL DISPLAY DESIGNS FOR K/s 2 PLANT 


T d * 05 secs ’ G d ^ 8 d2* 8 d3^ 


Case 

q e 

r 2 

Optimal 

1. 

1 

2X10 -4 

[36.6, 11.9] 

2. 

2 

-4 

2x10 

[49.2, 13.0] 

3. 

2 

-4 

1x10 

[64.4, 16.3] 

4. 

4 

-4 

1x10 

[88.1, 17.3] 

5. 

4 

5x10" 5 

[118.2, 22.6] 


F 
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From the results presented in Table 4.1 it is noted that as the 

relative weighting on the error is increased, the display sensitivity 

(t gj->) becomes larger. This is because a low value for f„ , was chosen 
d d2 2d 

as discussed earlier. But, as the analysis in the following section 
will show, it is the relative position and velocity gain magnitudes in 
the display which are of most interest, rather than the absolute values 
of the display gains. 

4_.2^ Evaluation of the Display Quickening Control Laws 

The display gains obtained in Section (4.1) are now to be evaluated 

using the full-order human operator model, with the same parameters in 

the model as given in Section (2.1). For the purposes of comparison, 

the initial display case (C = [20, 0]) and the limiting case of no 

d 

display lag are also evaluated. 

The display designs of Section (4.1) are referred to as Designs 1 
to 5, as defined in Table 4.1. The limiting case of no display lag is 
referred to as "A", the initial display case as "B" and the case of best 
performance obtained through trial and error in Section (2.2) as "C". 

4_. 2^J_ Mean-Square Analysis 

The OCM analysis results, in terms of the mean-square values of the 
tracking error, the human's control rate, and control input for the 
various cases of display augmentation mentioned above, are listed in 
Table 4.2. These results are also plotted in Figures (4.1) and (4.2). 
Fig. (4.1) is a plot of mean-square error vs. mean-square control rate, 
and Fig. (4.2) is a plot of mean-square error vs. mean-square control 
input. The scales are chosen to be compatible with Figs. (2.2) and 
(2.3). 
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TABLE 4.2: OCM ANALYSIS RESULTS FOR VARIOUS CASES 












A : No Display-Lag 


B : G = [20, 0] 
a 

c : G d = [20, 3] 


Beg. Display 






Mean Square Error (in. 
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Figure 4.2 Error vs. Manual Control Activity for Various Displays 
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From these results It is clear that as the relative weighting on 
the error in the cost function is increased, the optimal cooperative 
display design methodology leads to display gains which give improved 
performance at the expense of increased control activity. It is noted 
that for all the 5 cases obtained using the cooperative methodology, the 
final optimal display gains are such that the performance is signifi- 
cantly improved as compared to the starting display (B), and at the same 
time the "workload" (6) and the control effort (6) are considerably 
reduced. If the weighting on the error is high (Cases 4 and 5), perfor- 
mance comparable to the limiting case (A) and the best performance case 
(C) is obtained, along with reduced workload and control effort. More- 
over it appears that for the selected display bandwidth (a J = -20 

d 

sec *), tracking performance (rms error) better than that of Case 5 can- 
not be obtained. Increasing the weight on error in the cost function J ? 
any further would only have the effect of leading to a display design 
requiring higher control effort without any noticeable improvement in 
performance. 

4_. 2^. 2^ Power Spectrum Analysis 

Using the OCM modeling technique, the power spectra of the human's 

control inputs and the system responses can also be estimated. Note 

2 

that the mean-square value of a zero mean process x is related to the 

area under its power spectral density E^(co), or 

00 

a 2 = i / E (aj)da) (4.2.1) 

X TT ' X 
O 

Figure (4.3) provides a comparison of the power spectra of the human 
operator's control input (6) for the displays 1, 3, and 5, and the lim- 



Control Spectrum, A(w) (dB) 
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iting case A. The plots in Figure (4.3) show that the control power 
required is lower for all the optimally synthesized displays when com- 
pared to the idealized Case A with no display lag. Moreover, the peak 
value increases as the weighting on the error in the cost J ? is 
increased, corresponding to the human's task becomes increasingly more 
difficult from display design 1 to design 5. The power spectral densi- 
ties of the human's control input 6 for all the displays are shot-m in 
the Figures (C.l) to (C.6) in Appendix C. These figures include: 1) the 
total control input power (in dB) , 2) the portion of the control corre- 
lated with the command driving the system, and 3) the human operator's 
remnant, or the uncorrelated portion of the control input. 

Since the mean-square value of the errors for the display cases 1 
to 5 and the limitintg Case A were not significantly different, (see 
Table 4.2), the power spectral densities of the errors for these cases 
would be expected to be similar. This was indeed found to be the case 
and so the error power spectral density plots are not included in the 
report . 

iL-JLvl Frequency Domain Analysis 

The human operator model can also be represented in the frequency 
domain in terms of the transfer matrix between the human's observations 
and his control inputs [6,13]. Since the Bode characteristics of the 
plant and the display are known, frequency-domain analysis of the 
manually-controlled display-augmented systems can be carried out, once 
the human describing functions are estimated from the model. 

With the human operator so represented, the blodk diagram for the 
task is shown in Fig. (4.4). The display-augmented system is defined as 


Remnant 


5 



Figure 4.4 Block Diagram for Display Augmented Plant 







and the human describing function is 


pcs) 

- x d cs; 

For the displays I, 3, 5, and A, G(s) and P(s) are compared in Figures 
(4.5) and (4.6), respectively. (The Bode-plots of G(s) and P(s) for the 
cases 1 to 5 and the Case A are shown in Appendix C.) From these fre- 
quency responses in Fig. (4. 5) and Fig. (4. 6), the open-loop Bode-plots 
may also be determined (not shown). It appears that open-loop magnitude 
crossover (u) such that | P( iai) G ( .1 to ) | = 0 dB) is approximately constant 
at between 2-2.5 rads/sec for all these cases, consistent with the com- 
mand signal bandwidth (break at 2 rads/sec). Also, as the weighting on 
error increases (Case 1 -> Case 5), the sensitivity (gain) of the total 
plant plus display increases. From Fig. (4.5) it is clear that all the 
synthesized displays provide additional lead between 1 and 10 rads/sec. 
As the weighting on the error in the cost J ^ is increased (Case 1 -> 

Case 5), this phase lead provided by the synthsized display gains 
decreases. 

The human operator's phase compensation in Fig. (4.6) is more 
easily interpreted by looking at this phase compensation with the time 
delay (x) of 0.2 seconds removed. This adjusted phase is then given by: 


pc(oi) = 4- P(j&>) + 57.3 x to (4.2.2) 

A comparison of this adjusted phase for the various display cases is 
provided in Figure (4.7). From these plots it appears that the human 
would need to generate much higher phase lead for Case A as compared to 
all the optimal display augmentation cases. For Cases 1-5, the required 
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Figure 4.6 Comparison of Human Describing Functions, P(s) 
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phase lead increases with the increase of error weighting in the cost 
function J^. Thus, using the phase lead as a measure of workload, the 
trends in Figure (4.7) indicate that the display augmentation reduces 
the human's workload. Moreover, the plots predict increasing workload 
as the error weighting (q^) is increased in the synthesis of the 
display. 


With C(s) and P(s) known, the closed loop transfer function, 
x( s) 

T(s) = ~ , <rjry> is easily obtained, through algebraic manipulations using 
c 

the block diagram of Fig. (4.4), to he 


\ P(s) D e (s) 

T 1 (4.2.3) 

V s ' 1 - -4 P(s) [D (s) + s D. ( s) ] 
s 2 e x 

g g 

Here D (s) and D.(s) , x (s) is the commanded position 

e = s — a. = s - a, c 

d x d 

and x(s) is the plant position state. Closed-loop frequency response 
for Cases 1,3 and 5 of display augmentation is compared in Fig. (4.8). 
The magnitude and phase plots in Fig. (4.8) indicate that as the error 
weighting (q^) is increased, the synthesized display is such that track- 
ing performance is improved. 

Hence, both by comparing these results from the display augmenta- 
tion synthesis technique with the results of Chapter 2, and through 
additional closed-loop analysis, one can conclude that this synthesis 


technique appears to lead to desirable results. 


Frequency (rads/sec) 


Figure 4;8 Comparison of Closed-Loop Frequency Response 
for Displays 1,3 and 5 
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CHAPTER 5 

APPLICATION OF COOPERATIVE METHODOLOGY TO A 
MORE COMPLEX DISPLAY DESIGN 


In this chapter, an example application of the optimal cooperative 
methodology to a higher-order system in a multi-input task is presented. 
The intent is to demonstrate the application of the cooperative metho- 
dology to complex systems and the design presented here should not be 
considered a finalized design. The chosen plant to be controlled 
represents the unaugmented longitudinal dynamics of an aircraft, and the 
task is that of tracking a normal-acceleration command while regulating 
Mach number. The control inputs available to the pilot are the elevator 
stick and throttle, and the pilot may be assumed to be controlling the 
aircraft remotely from the ground, for example. The chosen model and 
the task formulation are discussed in detail. 

The task is first described and modeled, using an initial unaug- 
mented status display. Then an optimal display augmentation control law 
is synthesized using the proposed algorithm. The pilot's performance 
for the unaugmented and the augmented display systems is then evaluated 
and compared. Based on these evaluations, improvement in performance and 
reduction in the pilot workload is predicted for the optimally augmented 
display. 

JL’J. System Dynamics 

The dynamics are those for an F-15 type aircraft without any flight 
control augmentation, but including a Mach sensor (with lag), a thrust 
lag modeling the engine, and a fast first order actuator for the eleva- 
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tor control. (This model is from Ref. [21], but without the command aug- 
mentation system.) The vehicle state vector is 

y 

x^ = [V,a, q, 9, 6^, M, 6T] - the perturbed forward velocity (ft/sec), 

angle of attack (.01 rads), pitch rate (.01 rads/sec), pitch attitude 

(.01 rads), the elevator deflection (.01 rads), sensed Mach number (.001 

2 

Mach), and the thrust acceleration (ft/sec ). 

T 

The pilot control vector is 6 = [ 5 , <ST ] - the commanded eleva- 

ec c 

tor deflection and the commanded thrust acceleration. The state-space 
representation of the model is 

J 


x = A x + B <S (5.1.1) 

V V V V 

where the matrices A^ and are as given in Appendix D. The states are 
the perturbed values about the trim conditions also listed in Appendix 


n. 

The pilot's assumed objective here is to track a normal accelera- 
tion command (a ) while regulating Mach number to the best of his abil- 
zc 

ity. Rather than the deterministic normal acceleration command (a ) 

zc 

used for the pushup-pullover maneuver in previous studies [A, 5], the 
command signal to be tracked is generated, for the purpose of display 
control law synthesis, by using a second order Markov process with a 
break frequency of 1 rad/sec and a damping ratio of 0.7. With 
.*j* a * 

x — [a , a ], the command system is represented in the state variable 
c = zc zc 

form as 


x = 
c 


0 1 

-1 -1.4 


x + 
c 


w 


(5.1.2) 


The intensity of > the white noise process w^ is chosen to be = 


181 so 
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2 

as to yield the rms command of a =8 ft/sec (or 0.25 g's). 

ZC 

Defining x q — {x c , X V 1 « the vehicle dynamics augmented with the 
command system are written in the state-space form as 

• 

x =Ax + B 6 + D w (5.1.3) 

o o o o o c 

with appropriate definitions of A q , and I) . The time response of the 
variables a^, M and 9 is obtained for unit step control inputs. The 
time histories for step elevator input are shown in Figures (5.1 (a)- 
(c)) and those for step throttle input in Figures (5.2 (a)-(c)). 

_5.2. Task Model ing 

For the initial unaugmented status display, the pilot's observa- 
tions are assumed to be the normal acceleration command signal, the a 

z 

tracking error (e = a -a ) , the sensed (lagged) Mach number and pitch 

3 Z Z C Z 

attitude. It will again be assumed that the pilot can reconstruct the 
rates of the displayed signals. Then the pilot's observation vector, 

y l = [a , a , e , e , M, M, 8, 0], is of the form 
p zc zc az* az’ 

y = C x + E 1 (5.2.1) 

p o o 

with C q and E q as given in Appendix D. A conceptual display format for 

this status display is shown in Fig. (5.3). 

For the augmented display system, the pilot's observations are to 

be x,,, x,_, a and 9, along with the associated rates. (Note that 
dl’ d2 zc 

compared to the status display case, e and M are replaced by the 

3 Z 

"intelligent" display variables .x,, and x,„, while a and 0 are main- 

al az zc 

tained in the pilot's observation vector). Therefore the outputs avail- 
able for feedback by the pilot are 
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Tine (sec) 


Figure 5.1(b) Mach Response to Step Elevator Input 
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Figure 5.1(c) 9 Response to Step Elevator Input 




( ft/sec 
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Figure 5.2(a) a z Response to Step Throttle Input 

lft/(sec ), +ve thrust) 


(0.001 Mach) 
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Figure 5.2(b) Mach Response to Step Throttle Input 






Figure 5.2(c) 9 Response to Step Throttle Input 



M (0.001 Mach) 


61 



CRT 


2 

(Assumed Markings at 0.5 ft/sec and 0.5 M) 


Pilot's objective: (a) Keep Q over the a bar 

zc 

(b) Keep <] within + (15) M 


Figure 5.3 Conceptual Display Format for Status Display 
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Y p ~ [x dl’ x dl * x d2 * x d2 ’ a zc’ a zc’ 9,01 
A conceptual display format for the augmented system is shown in Fig. 

(5.4). 

Reasonable pilot modeling parameters for this analysis are as fol- 
lows : 


(i) Pilot's observation time delay, t, set to 0.2 seconds. 

(ii) Observation noise ratio set at -12 dB for all observations. 

(iii) Motor noise ratio set at -12 dR for both control channels. 


(iv) The weighting on the control rates in the pilot's cost func- 
tion adjusted to yield a neuromotor lag time constant of 0.2 secs 
in the elevator channel and 5 secs in the throttle channel. 


(v) The pilot's fractional attention allocation C f ^ ) was set at 

0.3 for each of the observations a , e and M, and 0.1 for 9. 

zc az 

(vi) The pilot's indifference thresholds for the various observa- 
tions are set to values listed in Table 5.1. 


Though parametric performance analysis is not too sensitive to many 
of these variables, the values of observation and motor noise ratios are 
chosen to be higher than in Chapter 2 in order to be consistent with the 
pilot behaviour observed in real-time simulations of complex tasks. 

Also the pilot's neuromotor lag time constant for the throttle channel 
is set at 5.0 secs to reflect the fact that the pilot changes the throt- 
tle setting very slowly, since the engine response is slow. Finally, 
from Fig. (5.3), it is seen that though the pilot observes a , e and 

Z C 3 Z 


ar >d x (display units) 
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zc 


(ft/sec ) 


(Assumed Markings at 0.5 display units for x„, and x,_) 

dl dz 

Pilot's objective: (a) Keep Q at 0 marking for x 

(b) Keep <] at 0 marking for x 


dl 


d2 



o 

Attitude 6 
(Markings at 1°) 


Figure 5.4 Conceptual Display Format for Augmented Display 
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TABLE 5.1 PILOT PERCEPTION THRESHOLDS 


Observation 

Threshold 

' 

Rate Threshold 

2 

a (ft/sec ) 
zc 

0.5 

1.0 

2 

e (ft/sec ) 
az 

0.5 

1.0 

M( .001 Mach) 

0.5 

1.0 

9 (.01 rads) 

0.2 

0.4 

x,, (display units) 
ell 

0.5 

i.O 

x,„ (display units) 

QZ 

0.5 

1.0 
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M (a , x^ and for the case of augmented display - Fig. (5.4)) from 

the same physical display, he still needs to scan their values 
separately. So we will consider his attention to be divided equally 
between the three primary observations, with attitude information only 
secondary to the task. The choice of the values for pilot's thresholds 
is based on the assumed display size and minimum resolution in the con- 
ceptual display format of Figs. (5.3) and (5.4). The thresholds for the 
rates are twice the thresholds for the corresponding displayed variable, 
for all the. pilot's observations. 

For the unaugmented status display, the pilot's objective function 
is taken to he 

T 

J ("6) = F{ lim -= / (e 2 + .0001M 2 + .05(ST ) 2 

P T+oo T i az c 

+ V^ ec > 2 + 8 2 (6T c )2)dt} (5.2.2) 

which reflects the pilot's emphasis on tracking the a command, and also 

z 

is consistent with the units of a^ and M in the dynamic model. This 

objective corresponds to the pilot attempting to keep the square, in the 

display format of Fig. (5.3), over the a bar, while at the same time 

zc 

maintaining the Mach needle within + (15). Note in this case the 

pilot's commanded thrust ( 6T ) is explicitly included in the cost objec- 

c 

tive. This was found to be necessary to keep the commanded thrust within 
limits deliverable by the engine. The weightings in (5.2.2) wefe deter- 
mined after a few trials of the modeling procedure. Finally, in 
(5.2.2), gj and g 2 are chosen to be consistent with the assumed pilot's 
neuromotor lag time constants for the two control channels. 

_5 ._3 Optimal Display Synthesis for F-15 Model 
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For designing display augmentation for the aircraft discussed 
above, the basic display dynamics may be taken to be of the form 



or 


with 


x d = Vd + Vd 


(5.3.1) 



y d = ta zc’ a zc’ V ’ “» q ’ 9 ’ 6 e’ (5.3.3) 

which means that all the vehicle states as well as the command states 

are available for driving the display. Note that in (5.3.1), the 
display bandwidth is chosen to be faster than the pilot's dynamics. 

Also two display states (along with two display control laws) are 
chosen. 

Defining Controller 1 to be the pilot's inputs, or u^ 4"^* the 
dynamics of (5.1.3), augmented with the display system and pilot's con- 
trol inputs can be written as 
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where Che two-dimensional white-noise process v is the pilot's motor 

m 

noise in the two control channels. 

With the augmented display (see Fig. (5.4)), the pilot's task is 

that of regulating the display states x,, and x,„. This can be modeled 

d 1 d L 

as finding the optimal Controller 1 ("u ) which minimizes the cost func- 
tion J given by 

T 

J,(u ) = E{lim i /(x 2 + x 2 + 0.05(6T ) 2 

11 T^o T o dl d2 C 

+ g ( 6 ) 2 + g,(6T ) 2 )dt } (5.3.5) 

l ec L c 

The objective function J 0 to be minimized by the display control 
law u is, however, taken to be 


J 0 = J (6) + Eflim 1 /.00001(u 2 + u 2 )dt} (5.3.6) 

2 P t-^°° T o dl d2 

Note here that J ("6) is as in (5.2.2), or the pilot's objective with the 

status display. The weights on the display controls (u,, and u,„) are 

dl d2 

chosen to be very small initially, at least, so that their contribution 
to is negligible as compared to J^(5). The choice of as above is 
consistent with our objective of finding a display control law which 
helps the pilot perform his overall task of tracking the a^ command 
while regulating the Mach number. 

In order to initialize the numerical solution technique, an initial 
guess for the display control gains is made such that x^j corresponds to 
-e (i.e. a -a ) and x _ to 0.01 M in the steady state. Recalling 

dZ Z ZC Ci z. 

Eqns.(5.3.2) and (5.3.3), then, the starting display control gains are 


start 


-20 

0 


For this choice of G , 

d 


0 -0.082 -32.21 0 0 -5.096 0 

0 0 0 0 0 0 0.2 

Jj(uj) for the initial display law closely 
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represents J (6) of the original status-display case. 

P 

The optimal display control gains determined from the algorithm 
converged to 


* 

G d " 


-26.08 -6.320 -1.475 -38.05 -12.06 -4.019 4.923 3.219 ' 

-18.72 -16.74 0.8258 -13.44 -36.74 -15.40 33.06 -0.202 


(5.3.8) 

In the synthesis process for the optimal display, the weightings g 


1 


and §2 i n the cost function J^(u^) and the variances for the noise 
processes v^ and v^ are constantly updated so as to make the controller 
u^ closely approximate the full-order pilot model. 


_5 . 4_ Comparison of the Displays 

The pilot's performance, as predicted by model-based evaluation, is 
compared for the two cases - the status display and the "optimal" 

2 

display augmentation synthesized as above. As in the case of K/s 
plant, the criteria used for comparison are - rms values of the vari- 
ables of interest, control and error spectra, and frequency domain 
analysis. Time histories for step control inputs are also provided to 
gain a better understanding of the significance of the "intelligent" 
display variables x^ and x^* F° r brevity, the status display is 
referred to as Display A and the optimal display as Display B in the 
following discussion. 

^5 . 4_.J_ Time Histories 

For Displav B, the time histories for the two display variables x 

d 1 

and x^ for a unit step elevator input are shown in Figs. (5.5 (a)-(b)) 
and those for a unit throttle input are shown in Figs. (5.6 (a)-(b)). 
Significant coupling is evident in this case, especially for elevator 




Figure 5.5(a) Response to Step Elevator Input 

(6e c = 0.01 rads, +ve down) 
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Time (sec) 


Figure 5.5(b) x : ^ Response to Step Elevator Input 


(display units) 







(display units) 
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Figure 5.6(b) x Response to Step Throttle Input 
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commands. From these time responses, it would appear that the strategy 

for the pilot might be to attempt to "control" x with the throttle and 

x,„ with the elevator. This is due to the fact that x,„ is essentially 
d2 d2 

uncontrollable from throttle inputs, Bor a step normal acceleration com- 
mand, there will be an instantaneous change in both x,, and x,„ (as is 

dl d2 

apparent from the optimal display gains G in (5.3.9)). In order to fol- 

d 

low the command, then, the pilot's strategy would appear to be to apply 
the elevator to regulate x^ ? and simultaneously use the throttle to mill 
out the effects of the elevator command and the normal acceleration com- 
mand on x„. The ultimate success of this strategy as well as comparison 
with that for the case of status display (Display A), of course, 
requires additional analysis and simulation. 


_5 ,4_. 2_ Frequency Domain Analysis 

The block diagram representations for the pilot's task formulated 
as above are shown in Figures (5.7) and (5.8) for Displays A and B, 
respectively. Note that in each case the pilot has four observations 
and two controls available to him. (The rate observations, as stated 
earlier, are reconstructed by the pilot from the displayed signals.) So 
the frequncy-domain representation of the pilot consists of a 2 x 4 
transfer matrix. For Display A the pilot representation is 


P(s) 


and for Display B 


P(s) 


P 6e 

P _j5e 

P 6e 

P 6e 

a 

zc 

e 

az 

M 

T 

p „ 

P 

P 

p 

* <5T 

6T 

67 

6T 





a 

zc 

e 

az 

M 

0 


P _j5e 

P 6e 

P 6e 

P* " 
6e 

a 

zc 

X dl 

X d2 

0 

p 

P 

P 

p 

5T 

6T 

6T 

5T 

a 

zc 

X dl 

X d2 

T 


(5.4.1) 


(5.4.2) 
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Figure 5.7 Block Diagram for Status Display 
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Figure 5.8 Block Diagram for Augmented Display 
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Here P is the pilot describing function fron the normal acceleration 
oe 

a 

zc 

command observation a to the commanded elevator input 6 . The other 

zc r ec 

elements of (5.4.1) and (5.4.2) are similarly defined. The Bode-plots 
for the eight pilot describing functions for Display A are presented in 
Figures (D.l) to (D.8) and those for Display B in Figures (D.9) to 
(D.16) in Appendix D, for reference. 

With the pilot represented by eight transfer functions, it is not 
straightforward to define a meaningful measure of pilot workload in the 
frequency-domain. Since the vehicle dynamics and the display dynamics 
are known and the various pilot describing functions are available as 

o 

above, additional frequency-domain analysis, as in the case of the K/s" 
plant, may in principal be performed using the block diagrams of Figures 
(5.6) and (5.7). However, the results presented in Chapter 4 showed that 
the performance and workload information obtained from statistical and 
spectral analysis of the model-based predictions is consistent with that 
derived from the other frequency-domain analysis. Therefore, results 
from statistical and spectral analysis will be used to evaluate and com- 
pare the two Displays A and B. 

j^.4^_3 RMS Analysis 

Using the complete human operator model, closed-loop analysis was 
performed for both the status display (A) and the optimal augmented 
display (B). The rms values for the variables of interest for the two 
displays are shown in Table 5.2. From these results it is clear that 
there is a slight improvement in a^ tracking performance for the case 
with display augmentation, and Mach number regulation is much improved. 
Both the pilot control inputs and control rates are lower for the 
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TABLE 5.2 OCM ANALYSIS RESULTS 


(a) Performance Measures 


Classification 

e 

az 

2 

ft/sec 

• 

e 

az 

M 

.001 Mach 

8 

.01 rads 

A: Status Display 

7.009 

11.920 

39.11 

8.45 

B: Optimal Display 

6.659 

9.349 

11.32 

3.36 


(b) Workload Measures 




• 


• 

Classification 

6 

6 

6T 

<$T 


ec 

ec 

c 

c 


.01 rads 


2 

ft/sec 


A: Status Display 

2.95 

13.21 

2.566 

0.1742 

B: Optimal Display 

1.78 

8.06 

0.819 

0.1228 
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optimal display case, indicating that the designed display augmentation 
should lead to reduction in pilot workload. 

_5.4_.4_ Spectral Analysis 

The power spectra of the a^ tracking error and both the control 

inputs for the Displys A and B are shown in Figures (D.l) to (D.6) in 

the Appendix D. These plots show the total power (in dB) , the portion 

correlated with the command driving the system, and the uncorrelated 

part, or the contribution due to the pilot's remnant. 

The a tracking error power spectrum for the Displays A and B is 
z 

compared in Figure (5.9). This power for Display R (augmented case) is 

slightly higher than Display A at low frequencies, but is less than 

Display A for frequencies above 0.7 rads/sec. Even though the rms 

tracking error with the optimal display (B) is not too much lower than 

that with the status display (A), the augmentation appears to reduce the 

errors at the more-demanding higher frequencies. 

The pilot's commanded elevator power spectrum and commanded thrust 

power spectrum for Displays A and B are compared in Figures (5.10) and 

(5.11), respectively. From these figures it is clear that the power for 

both pilot control inputs is much lower at all frequencies for the 

2 

optimal display case. As was the case of K/s plant, this is an indica- 
tion that the pilot's workload in accomplishing the task should be 
reduced. 

Thus, from this initial example application, it appears that the 
suggested display augmentation synthesis technique can lead to desirable 
results when applied to manual control of complex dynamics. As further 
experience is gained in applying the technique, even better performance 
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Figure 5.10 Comparison of Pilot Commanded Elevator Spectrum 
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CHAPTER A 


SUMMARY 


The objective of this effort was to develop an analytical technique 
to aid in the design of display augmentation. The main differences 
between display augmentation and control augmentation were pointed out 
using simplified block diagrams. Although different from augmenting 
plant dynamics, it is usually possible to improve human operator perfor- 
mance in manual-control tasks by providing the human with an augmented 
display. 

Model-based evaluations were performed for various emperically- 

2 

derived display "quickening" control laws for a simple K/s plant in a 
compensatory tracking task. The results of this analysis, in terms of 
mean square values of tracking error and manual control activity and 
rate, showed that significant reduction in human operator workload and 
improvement in performance is possible through a proper design of the 
signal being displayed to the human. 

The cooperative control synthesis technique previously developed to 
design pilot-optimal control augmentation was then extended to incor- 
porate the simultaneous design of pilot-optimal display augmentation. 

The problem formulation for the cooperative synthesis technique was dis- 
cussed in detail and the necessary conditons for optimality were 
derived. A numerical algorithm for applying the methodology to perform 
pilot-in-the-loop synthesis of optimal display augmentation control laws 
was then presented. 

The application of the methodology to a simple system was demon- 
strated by synthesizing various display augmentation control laws for 
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2 

the X/s plant. By varying the weighting parameters in the cost func- 
tion, it was shown that this methodology has the potential of providing 
a systematic approach to design of task tailored display augmentation. 
The synthesized display designs were evaluated, using the full-order 
human operator model, in terms of the mean square values of the vari- 
ables of interest and the power spectrum of the human operator's control 
input. The evaluation results predicted a reduction in human operator 
workload and improvement in tracking error performance with the aug- 
mented displays. Moreover, when compared to the emperically-deri ved 
display "quickening" control laws, the results tended to validate the 
cooperative approach to display design. 

Detailed frequency domain analysis was also performed for the syn- 
thesized displays, using the frequency-domain representation of the 
human operator model. All the augmented displays were shown to provide 
the human operator with some lead information, reducing the required 
human operator phase compensation from the case with no display augmen- 
tation. A comparison of the closed-loop frequency responses for the 
various synthesized displays indicated that the cooperative methodology 
does lead to desired results. 

An initial application of the methodology to high-order system 
dynamics with a multi-control task was then demonstrated, using a 
normal-acceleration tracking task and an F-15 type aircraft model. The 
problem formulation was discussed in detail and a preliminary display 
design was synthesized using the cooperative technique. Analytical 
methods for evaluating the synthesized display for the complex task were 
again employed, and the results of the analysis were compared with those 
for an unaugmented status display. Based on the statistical analysis 
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results, improvement in performance and pilot workload is predicted for 
the synthesized optimally augmented display. 

Since the model-based evaluation of the display designs predicts 
promising gains in pilot workload, it is suggested that these results be 
validated through real-time, man-in-the-loop simulation. For the display 
design synthesized for the aircraft model, further insight needs to be 
gained into the significance of the two display variables. Finally, the 
application of the cooperative methodology to display design for complex 
systems should be further explored, and systems considered for which 
other methods have been used to synthesize the display, to provide 
further comparison and validation. 
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APPENDIX A ' 

DERIVATION OF NECESSARY CONDITIONS FOR CONTROLLER 2 (u N 
2 ) 


As stated in section (3.4), the system dynamics in the presence of 
the control action can be written in terms of the augmented state 
vector q as ' 


q = A iq + B 2 u 2 + B d u d + D w 


(A. 1 ) 


where q, A,, B„ , B, , and D are as defined in section (3.4). The out- 
I l d 


puts y 2 and y d are given in terms of q by 


y 2 = [C 2 0] q = C 2 q 

? d = [C d Ojq = c'q 

and the index of performance J 2 becomes 


(A. 2) 


J 2 = E{ lim ^ /(q T Q q + U 2 F 2 U 2 + u d F 2d u d^ dt * 
T-* 00 o 


(A. 3) 


with Q again as defined in section (3.4). 

The closed loop system under the action of Controller 2 (u 2 ) and 
the display control law u d> with the control laws as given by (3.1.5), 
can then be written in a compact form as 


where 


q = A q + D w 
c 


(A. 4) 


M.C A. 

1 aug 1 


with A , C and A, as defined in Chapter 3. 
aug aug 1 


aug 


B 1 K 1 


The system given by (A. 4) is identified as a linear stochastic time 
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invariant system driven by a white noise process w . From linear sto- 
chastic system theory [12], in the steady state case the system state 
covariance matrix L is obtained as the solution to the following 
Lyapunov equation 


A L + LA T hBWD T = 0 
c c 

where W is the intensity of the process w and L=E[q q ]. 


Using the trace operator [17], can be expressed as 


where 


J 2 = tr[QL] 


Q - Q + 


C 2°2 F 2°2 C 2 + 


C d G I F 2d G d C d 


0 

0 


(A. 5) 


(A. 6) 


(A. 5) and (A. 6) can now be treated as a constrained parameter 
optimization problem [18]. Defining H as a symmetric matrix of Lagrange 
multipliers, the cost J 2 can be augmented with the constraint (A. 5) to 
get 


J. = tr[QL] + tr[H(A L + LA T + D W D T )] (A.7) 

L C C 

The necessary conditions for optimality applied to (A.7) yield the 
following relations 



A T H + HA + Q = 0 
c c 



3H 


m * * f wvt 

A L + LA + D W D 
c c 




= 0 


0 


(A. 8) 
(A. 9) 
(A. 10) 


(A. 1 1) 
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Equations (A. 10) and (A. 11) need further elaboration because the 

augmentation gains G„ and the display control gains G, are embedded in 

L a 

the dynamics of the closed loop system. 


(a) 


3J 2 

IgI 


In J^, the terms containing G 2 are Q and A^. Therefore 


3J 2 


{ tr[QL] + 2tr [HL aJ] } 

C 


(A. 12) 


where the trace identity tr[HA L]=tr[HLA ] has been made use of. 

c c 

Further note that in A , G, appears both in A as well as in A, . But 

c 2 rr aug 1 

Aj is part of the optimal Controller 1 (u^, as is apparent from 


1 ' 


(3.4.1), and since we are looking for a Nash solution, Controller 1 is 
to be considered fixed in the minimization process for J 2 . Thus the 
only gains that may be adjusted in Controller 2 are those in A & where 
A = A + B-G„C 0 + B ,GjC, . Then 

aug 2 2 2 d d d » 


-sSr trtH “c> ■ -k. tr(HL 


B 2 G 2 C 2 


(A. 13) 


Noting that 


T T T 
C 2 G 2 B 2 0 

0 0 


g 2 [b 2 0] 


(A. 14) 


(A. 13) can be simplified to get 


3G„ 


tr{HL 


g 2 [bJ 0)} 


[b 2 0]HL 


(A. 15) 


Also from the definition of Q we have 
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C 2 G 2 F 2 G 2 C 2 0 

IgJ tr ' GL ' ’ TgJ tr * 0 o L * 


^"<0 G 2 F 2 G 2 [C 2 ° 1 « 


’ 2F 2 G 2 [C 2 o 


Combining (A. 15) and (A. 16), the condition (A. 10) can be written in the 
expanded form as 


T T 

r A p 1 

3J 2 ^2 

Icf- 2 ' F 2 G 2 [C 2 0!L 0 + [B 2 ° 1HL 0 1 “ 0 


In the terms containing are Q and A^, Therefore as before 


157 ' -557 {tr[QLJ + 2 «t«“c n 

d d 


Again noting that in A^, A^ and are part of the optimal con- 
troller 1 (u^), the only free gains to be adjusted are those appear- 


ing in A and C . Then 
aug aug 


B d G d C d ° 

IgT tr f HLA <J = ~§g~ tr tHL M C G C 0 * 
d d 1 u d d 

The matrix on the right hand side of (A. 19) can be written as 


B d G d C d ° B d 

M C G C 0 = M C G d [C d 

1 u d d 1 u 
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which gives 


3 

3G . 



" BjG ,C , 0 

a a a 


' B d' 

T 

c T 

C d 

tr{HL 

M. C G. C, 0 
1 u a a 

> = 

M.C 
1 u 

HL 

0 


(A. 21) 


Further, similar to the procedure used to get (A. 16), we have 


3G . 


tr[OL] = 


2F 2d°d [C d 011 


(A. 22) 


Combining (A. 21) and (A. 22), (A. 11) can be written in the expanded form 
as 


3J ? 

157 ' 2,F 2d G d [c d olL 


M,C 
1 u 


HL 


(A. 23) 


(A. 8), (A. 9), (A. 17) and (A. 23) together give the necessary condi- 
tions for the simultaneously optimality of the augmentation controller 
U£ and the display control law u^. 
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APPENDIX B 

THE OPTIMAL CONTROL PILOT MODEL 


The optimal control approach to human operator modeling was 
developed by Kleinman, Baron and Levison in the early 1970's. Since 
that time it has been used successfully to model manual pilot behaviour 
in a variety of complex tasks. A brief discussion of the actual model, 
is given here as it forms the basis for the synthesis and analysis of 
display augmentation designs presented in this report. More detailed • 
discussion of the structure of the model can be found in [6] and [13], 
The model is based on the assumption that a "well-motivated" human 
pilot adjusts his gains and compensation for the vehicle and task such 
that an objective function, J^, is minimized, subject to human limita- 
tions. Typically a piloting task, aircraft and display dynamics are 
represented in the block diagram shown In Figure (B.l) and by the time 
invariant differential equation 

• 

x(t) = Ax(t) + bu (t) + Dw( t) (B.l) 

P 

where the A matrix can be an agregation of task, plant and control sys- 
tem dynamics. The vehicle states are represented by the vector x(t) 



poses of explanation - multi-input tasks are easily accomodated within 
the framework of the model) and w(t) is a "white" noise disturbance with 
intensity W. 

An output vector y^(t) represents those variables which the pilot 
can observe, either through the cockpit display, out the windows or by 
the "seat of his pants". 


His observations are given by the relation 



Figure B.l OCM Block Diagram 
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y (t) = Cx(t-x) + du (t-x) + v (t-x) 

P P 7 

where x is a pure delay associated with the inherent delay in the 


(B.2) 


pilot's perception, and v is a vector white noise process with inten- 
sity which models the imperfection in the pilot's observations. 

The pilot's task is reflected in the minimization of a quadratic 
performance index of the form ' 


* 1 T n 2 2 *2 

J (y ) = E{lim ■=• / ( £ q xf + n/ + gu^)dt} 
p T o i-1 1 1 p p 


(B.3) 


subject to pilot observations y (a) for time a < t and with cost func- 
tional weightings q^ > 0, r > 0, and g > 0. 

Inclusion of the control rate, u , in the cost function naturally 
leads to a first order lag in the pilot's control law analogous to the 
neuromotor lag of the McRuer crossover pilot model [14], The time con- 
stant of the lag, furthermore, may be adjusted through variation of the 
control-rate weighting constant, g. 

By defining a new state vector as 


X T (t) = [x T (t), u(t)], 

the augmented system can be represented as (u^(t) = P Q (t)) 


X(t) = A Q x(t) + b Q u o (t) + D Q w(t) 


(B.4) 


with 



A b 


o' 


'd 

A = 
o 

0 0 

• b o = 

1 

* D o = 

0 


The minimizing control law is 


W Q (t) = -ix(t) 


(B.5) 


with 
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1 = - b T K (B.6) 

g o o 

where x(t) is the current estimate of the state x(t)> and is the 
unique positive definite solution of the Ricatti Equation 

A T K + K A + Q --Kb b T K = 0 (B.7) 

oo op o goooo 

with Q q = diagCq^, r) . Expanding the optimal control law as 

* n 

u (t) = - I 1. P. (t) - 1..U (t) (B.8) 

o i i rr+i p 

where p^(t) is the current estimate of the system state x^(t), and let- 
ting 


T n 1 


(B.9) 


n+1 


by iterating the control-rate weighting, g, the equivalent lag time con- 
stant, t = - — — , can be adjusted to a desired value. The control law 
n n+1 

can then be written as 


x u (t) + u (t) - u (t) 
n p p 


(B. 10) 


where 


y (t) = -1 p(t) 
e 


(B. 11) 


with 


l — T [i«» •••» il 

e n l z n 

From the human operator viewpoint, an exact control input is not 


possible. This uncertainty is modeled by the addition of motor noise v 


m 


in the control equation, or 


x u (t) + u (t) = y (t) + v (t) 
n p p m 


(B. 12) 


where v (t) is a Gaussian "white” noise source with intensity, V . 
m m 


The 
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controller gains previously calculated are assumed to remain the same in 
the presence of motor noise. This assumption reduces the human operator 
model to sub-optimal control behaviour. 

The current state estimate is derived from the combination of a 
Kalman state estimator and a least mean square predictor. The system is 
rewritten as 


where 


X T (t) = [x T (t), u p (t)] 

X(t) = AjXCt) + bj mC t ) + D^Ct) 
y p (t) = CjxCt-x) + v y (t-T), v y ~ N(0, V ) 


(B. 13) 


A b 



n 



Cj = [C | d] , Dj - 


— 'T 

The disturbance noise has the form w^(t) 


D 0 


10 -p 

n 


fw T (t) , 


ance matrix 


v ( t ) ] with covari- 
m 


E{wj(t)wj(a)} = W,6(t-a) 


W 1 = 


W 0 
0 V 


m 


(B. 14) 


The Kalman filter generates an estimate, x(t) of the model states 
X(t) from 


A A 

x (t-r) = AjxCt-r) + b^Ct-x) 
+ ZjC^V -1 [y p ( t) - C^Ct-x)] 


(B. 1 5) 
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where the error covariance matrix, Z^ , is the solution of 

A 1 Z 1 + l + D^W 1 D 1 - Z 1 C^V~ 1 C 1 Z 1 = 0 
The least mean squared predictor is governed by the equation 


(B.16) 


5<t) = AjS(t) + b x u(t) (B.17) 

✓ 

Finally, the current state estimate is found by combining the Kalman 
state estimate and the predicted state through the relation 

_ V- 

P(t) = 5(t) + e [x(t-T) - C(t-T)] (B. 18) 

In order to apply the optimal control model, it is necessary to 

know the various human response parameters T » T n >^y>^ m introduced above. 

Published data in manual control [14] indicates that typical values for 

the effective time delay are t=0. 15-0.25 secs. The neuromotor lag time 

constant t is of the order of t =0. 1-0.6 secs with t 10. 1 being typical 
n n n 

[23]. It should be noted that results reported in [14] indicate that 
varies inversely with forcing function bandwidth. 

Investigation of the properties of human controller remnant [24] 
have shown that the sources of remnant can be modeled on the basis of 
constant noise to signal ratios. Thus the observation noise associated 
with the i*”^ 1 observed variable y^ has an intensity 


(V°) u - P yl E(y l) 


(B. 19) 


where the constant p . is based on the human controller's attention 

yi 

being limited to the i C ^ observation only. Similarly, the motor-noise 

v (t) is modeled to have an intensity given by 
m 


V = p E{u } 
m u p 


(B. 20) 


The constants p . and p are referred to as observation noise ratio and 
yi u 
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motor-noise ratio respectively, and are generally specified in terms of 
their decibel values. Model matching analyses have shown values of 
p^=0.01ir (-20 dB) and p u =0.003tt (-25 dB) to provide a good fit with 
experimental data for manual control tasks involving single-axis track- 
ing. These ratios have much higher values for complex multi-control 
tasks. Since the noise intensities are specified as ratios of the closed 
loop intensities of the corresponding signals, an iterative process is 
necessary to determine the optimal control model for which the relations 
(B.19) and (B.20) are satisfied. 

Studies of human perception abilities have shown that if a quantity 
y^ is displayed explicitly to the human operator, he can extract the 
rate of change of that quantity, y^. Thus the rates of the displayed 
quantities should be included in the pilot's observation vector y^. 
Furthermore, if the human controller has more than one explicitly 
displayed observation available to him, his attention is divided between 
the various displays. The error induced due to this division of atten- 
tion is modeled by modifying the observation noise corresponding to the 
i 1 "* 1 displayed variable as 


<Vii 


(v°) 

v y'il 


(B.21) 


where (V°)^ is as given by Eqn. (B.19). Here f^ is the fraction of 
total attention allocated to the i^ observed variable and has limiting 
values, at no attention (f^=0) and full attention (f^=l) [15]. The values 
of f^ are generally determined on the basis of the importance of that 


particular observation in successfully accomplishing the task as modeled 

by (B.3). 
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If a particular signal y^ is very small in magnitude, the human 
controller may not be able to detect its non-zero value (visual thres- 
hold) or may choose not to react to the small perturbations (indiffer- 
ence thresholds). This aspect of the human controller is modeled by 
modifying the observation noise intensity corresponding to the i*"^ 
displayed variable as ' 


(V ) 


iVii 


y 11 (N(a yi’ a i ))2 


(B. 22) 


where a y ^ = E{y^} and N is the describing function of a dead-zone ele- 

f 

ment [6]. (V y )^ is as obtained from (B.21) and is the value of the 
threshold for the i^ observation. Pyscophysical studies have shown that 
these thresholds typically correspond to values of 0.05 deg and 0.15 
deg/sec at the pilot's eye. Also, a reasonable value for these thres- 
holds is the minimum resolution marking on the display. 

Finally, combining (B.19), (B.21), and (B.22), the intensity of the 
obsevation noise v y ^ to be used in (B.2) to model the imperfections in 
the pilot's observations, is obtained to be 


( V ) = ii 

y 11 f i (N(a yi , c^)) 2 
with all the relevant quantities defined as above. 


(B.23) 
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Figure C.2 Control Spectrum for Display 
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Figure C.6 Control Spectrum for Display 
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Figure C.12 Pilot Describing Function for Limiting Case 
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Figure C.17 Pilot Describing 
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TABLE D.l: TRIM CONTIIONS FOR F-15 MODEL 


Altitude 

h 

32,000 ft. 


o 


Angle of Attack 

a o 

11° 

Pitch Angle 

9 o 

11° 

Mach Number 

M 

o 

.4775 

Velocity 

V o 

470.9 ft/sec 

Thrust 

T o 

6270 lb f 

Weight 

W o 

40,700 lb f 

Elevator 

6e 

o 

-4.76° 

Dynamic Force 

. qs 

55,821.1 lb f 




TABLE D.2 : MATRICES A AND B FOR F-15 MODEL 
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TABLE D.3: PILOT OBSERVATION MATRICES FOR STATUS DISPLAY 
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Figure D.l Pilot Describing Function 
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Figure D.8 Pilot Describing Function 





















• • 

ii:!i ifi’i i:‘:i c*.| i:’:i 

i:*.i in i':i i":i i* 1 :- c:. id 




i:.:i 

l“*l 




i:.:i 

O 


(3P) spn^fuSew 


(8aa) aseqa 























O c;a i::i 

im i*"i ci 

III! 


r 

o o o 

•XI I-- CD 

l I l 


. i i i r i i- 1 i -i -i -i t iii i i -i- i i i 

r.'.:i i:.:i i:.:i ' r.;a 

Ci o O i":» 

i;-.| t- -I- i;-,| 




(HP) apn^TuSBH 


(23(1) ssBMd 




















138 



O 

r.i 


Ci 


o 

ll"! 


Cl 

' ; ::i 


o o 

i— 1:1:1 


O ':ii> C'i 

o 

I i— i:-.i 


o 

o 




i:.:i 


C» 

O 

I 


Cj 

o 

v.-.| 


HI (M 
<o >a 

X 

CL, 


(gp) ©pmiuSsw 


(SaQ) asBqa 


Figure D.15 Pilot Describing Function 
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Figure D.17 e Power Spectrum for Status Display 
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Figure D.18 Pilot Commanded Elevator Spectrum for Status Display 
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Figure D.19 Pilot Commanded Throttle Spectrum for Status Display 
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Figure D.21 Pilot Commanded Elevator Spectrum for Augmented Display 




